A Fast Winner-Take-All Neural Networks With the Dynamic Ratio

نویسندگان

  • Chi-Ming Chen
  • Ming-Hung Hsu
  • Tien-Yo Wang
چکیده

In this paper, we propose a fast winner-take-all (WTA) neural network. The fast winner-take-all neural network with the dynamic ratio in mutual-inhibition is developed from the general mean-based neural network (GEMNET), which adopts the mean of the active neurons as the threshold of mutual inhibition. Furthermore, the other winner-take-all neural network enhances the convergence speed to become a decimal system. The proposed WTA neural networks statistically achieve the large ratio of mutual inhibition. The new WTA Neural Networks converge faster than the existing WTA neural networks for a large number of competitors based on both theoretical analyses and simulation results.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Winner-Take-All Discrete Recurrent Neural Networks

This paper proposes a discrete recurrent neural network model to implement winner-take-all function. This network model has simple organizations and clear dynamic behaviours. The dynamic properties of the proposed winner-take-all networks are studied in detail. Simulation results are given to show network performance. Since the network model is formulated as discrete time systems , it has advan...

متن کامل

Distributed ARTMAP: a neural network for fast distributed supervised learning

Distributed coding at the hidden layer of a multi-layer perceptron (MLP) endows the network with memory compression and noise tolerance capabilities. However, an MLP typically requires slow off-line learning to avoid catastrophic forgetting in an open input environment. An adaptive resonance theory (ART) model is designed to guarantee stable memories even with fast on-line learning. However, AR...

متن کامل

Dynamically-Adaptive Winner-Take-All Networks

Winner-Take-All (WTA) networks. in which inhibitory interconnections are used to determine the most highly-activated of a pool of unilS. are an important part of many neural network models. Unfortunately, convergence of normal WT A networks is extremely sensitive to the magnitudes of their weights, which must be hand-tuned and which generally only provide the right amount of inhibition across a...

متن کامل

Complex dynamics in winner-take-all neural nets with slow inhibition

-We consider a layer of excitatory neurons with small asymmetric excitatory connections and strong coupling to a single inhibitory interneuron. I f the inhibition is fast, the network behaves as a winner-take-all network in which one cell fires at the expense of all others. As the inhibition slows down, oscillatory behavior begins. This is followed by a symmetric rotating solution in which neur...

متن کامل

Spectra of winner-take-all stochastic neural networks

In Piekniewski & Schreiber (2008) we have developed a simple mathematical model for information flow structure in a class of recurrent neural networks and shown that its asymptotic behaviour is scale-free and admits a description in terms of the so-called winner-take-all dynamics. In the present paper we establish a limit theorem for spectra of the spike-flow graphs induced by the winner-take-a...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • J. Inf. Sci. Eng.

دوره 18  شماره 

صفحات  -

تاریخ انتشار 2002